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The spontaneous transitions between D -dimensional spatial maps in an attractor neural network 
are studied. Two scenarios for the transition from on map to another are found, depending on the 
level of noise: (1) through a mixed state, partly localized in both maps around positions where the 
maps are most similar; (2) through a weakly localized state in one of the two maps, followed by 
a condensation in the arrival map. Our predictions are confirmed by numerical simulations, and 
qualitatively compared to recent recordings of hippocampal place cells during quick-environment¬ 
changing experiments in rats. 


In 1982 J.J. Hopfield proposed a neural network model 
for auto-associative memories, in which specific configu¬ 
rations (patterns) of the activity could be stored through 
an adequate choice of the interactions between the neu¬ 
rons, modeled as binary units a = 0,1 pQ. Starting from 
an initial configuration partially ressembling one pattern 
the network configuration dynamically evolves until a 
fixed point, coinciding almost exactly with the stored 
pattern, is reached [2j. In this paper we consider an ex¬ 
tension of the Hopfield model, in which the attractors 
stored are continuous and ZJ-dimensional (with D > 1), 
rather than discrete fixed points (D = 0), and discuss the 
existence and the mechanisms of spontaneous transitions 
between those attractors. Besides its intrinsic interest 
from a statistical mechanics point of view our study is 
motivated by the observation of abrupt transitions be¬ 
tween the representations of space in the brain 0 , in 
particular in quick-environment-changing experiments on 
rats |4]. 

Continuous attractors are not unusual in statistical 
physics. An illustration is given by the Lebowitz-Penrose 
theory of the liquid-vapor transition [5]. Consider a 17- 
dimensional lattice, whose N sites xi can be occupied by 
a particle {pi = 1), or left empty (cri = 0). The energy 
of a configuration {cr^} is given by the Ising-like Hamil¬ 
tonian 

E[{ai},{xi}] = > (!) 

i<j 

where J is a positive and decaying function of its argu¬ 
ment, i.e. of the distance between sites. At fixed number 
of particles and low enough temperature translation in¬ 
variance on the lattice is spontaneously broken: particles 
tend to cluster in the x-space, and form a high density 
region (liquid drop) surrounded by a low-density vapor. 
The density profile of this ‘bump’ of particles hardly fluc¬ 
tuates, but its position can freely move on the lattice, and 
defines a collective coordinate for the microscopic config¬ 
uration of particles. 

From the neuroscience point of view, the existence 
of a collective coordinate, weakly sensitive to the high 
stochasticity of the microscopic units, is central to popu¬ 
lation coding theory [6]. Following the seminal discovery 


of ‘place cells’ in a brain area called hippocampus [7], 
continuous attractors have been proposed as the basic 
principle of the coding for position in space [8]. The 
model we consider here goes as follows [9]. In a rat mov¬ 
ing freely in a given environment, a place cell i becomes 
active (cq = 1) when the rat is at a specific location in 
the environment, called place field and centered in 
and silent otherwise (pi = 0). Place cells i,j with over¬ 
lapping place fields, i.e. such that the distance between 
Xi and Xj is small enough, may be simultaneously active, 
and have a tendency to strengthen their connection dur¬ 
ing the exploration of the environment. The potentiation 
of the couplings between coactive neurons is called Heb- 
bian learning, an important paradigm in auto-associative 
memories. In addition to the local excitation, global in¬ 
hibition across the network keeps the fraction of active 
units constant. As a result the probability of a place¬ 
cell activity configuration {cr^} would formally coincide 
with the Gibbs measure associated to model 0 , with a 
temperature T dependent on the neural noise. 

When the rat explores a new environment hippocam¬ 
pal place cells undergo a process called remapping, in 
which place field locations are randomly reallocated m ■ 
A simple model of remapping consists in randomly per¬ 
muting the indices of the place field locations, i.e. the 
center of the place field attached to place cell i becomes 
x n (i) , where tt is a random permutation defining the spa¬ 
tial map of the environment. We assume that the contri¬ 
butions to the interactions of the different maps add up, 
and obtain the Hopfield-like hamiltonian 

E[{ai},{Xi},{TT e }] = > ( 2 ) 

i<j 

where the couplings are 

L 

Jij ^ ^ J (|^7T £ (z) |) 5 (3) 

1=1 

L is the number of environments, and i the permuta¬ 
tion in the £ th environment (JL = 1,..., V). This J^-matrix 
exhibits a ‘small-world’-like topology [13;: the couplings 
due to an environment, say, i = 2$ in |3]), connect neurons 
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with place fields close to each other in this environment, 
while the other environments (JL 7 ^ /q) contribute long- 
range and random connections. Despite this structural 
disorder, in model © and in similar rate-based models 
with continuous units H2HE], the activity can be local¬ 
ized in any of the environments, i.e. the active neurons 
have neighboring place fields in one map, provided the 
load a = L/N and the temperature T are not too large. 

The purpose of this paper is to study the transitions 
between different maps, i.e. how the population activity 
can abruptly jump from being localized in one map to an¬ 
other one. For definiteness we choose the N place-fields 
centers to be the nodes Xi of a regular D-dimensional 
cubic lattice. The coupling function in 0 is set to 
J(r) = if r < r c , and 0 otherwise, where r measures 
the distance on the grid; the cut-off distance r c is such 
that each neuron is connected to its wN closest neigh¬ 
bors in each map. The fraction of active neurons is fixed 
to the value /. We report in Fig. [l] the outcome of Monte 
Carlo simulations of model 0 with L = 2 maps, referred 
to as A and B, in dimension D = 1 (See Supplemental 
Material at [url] for a simulation in D = 2 dimensions). 
The bump of activity diffuses within one map with little 
deformation, and sporadically jumps from map A to B, 
and back. We study below the mechanisms underlying 
those transitions, remained poorly understood so far. 

To capture the typical properties of model 0 we com¬ 
pute its free energy under the constraint that the average 
activities of neurons whose place fields are centered in x 
in map A and in y in map B are equal to, respectively, 
p A (x) and p B (y). We use the replica method to average 
the free energy over the random permutations 7 rG The 
outcome, within the replica symmetric hypothesis and 
for N —>• 00 , is the free energy per neuron: 


T = -- 


+ 


~\ J j df V A 0?M(|z-£'l)p A (7') ( 4 ) 

\ J dy J dy' p B (y)J(\y-y'\)p B (y') + ^-r(f-q) 
J d xp A {x)p A (x) + Jdyp B (y)p B (y)-rjf 


T 

fe# 0 


(? - m 


- T 


«-#r T1 ” s(1 - w " w . 

J dfdyD2log(l + e /3( ^ (5J)+/iB( ^ )+z ^“ , ' ) ) , 


where /3 = 1/T, Dz = exp(— z 2 /2)/y/2ii, A^ = 

n^Li sin(/c /x 7 rrc 1 / i:) )/( 7 r/c /x ) are the eigenvalues of the J 
matrix, and the components k M are positive integer num¬ 
bers. Fields p A (x), p B (y), and parameter r are conju¬ 
gated to, respectively, the densities p A (x ), p B (y ), and the 
Edwards-Anderson overlap q = JT (cq) 2 , where (•) de¬ 
notes the Gibbs average with energy 0 at temperature 
T, and (•) is the average over the random permutations. 
Parameter 77 is chosen to enforce the fixed-activity con- 
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FIG. 1: (Color online) Time evolution of a network with N = 
1000 neurons, and L — 2 one-dimensional maps. Each black 
dot represents an active neuron cn . Panels A and B show the 
same data, up to a permutation of the neuron indices i to sort 
place field centers in increasing order in the corresponding 
map (x-axis). Right: contributions to the total energy due 
to each map, divided by |/ 2 rc (absolute value of the PM 
energy). Parameter values: T = 0.007,/ — 0.1 ,w = 0.05. 
Each MC round includes 10 6 steps. 


straint: f dxp A (x ) = f dyp B (y) = /. 

Minimization of T allows us to determine the prop¬ 
erties of the ‘clump’ phase (CL), in which the activity 
has a bump-like profile in one map, and is flat (= /) in 
the other one, see Fig. |2|a). Details about the activity 
profile for a given realization of the maps are shown in 
Supplemental Material. This CL phase corresponds to 
the retrieval of one map. The phase diagram in the a, T 
plane is shown in Fig. [3^a), and also includes the para¬ 
magnetic (PM) phase at high T and the spin-glass (SG) 
phase at high <a, in which no map can be retrieved In 
the PM phase, the neural noise is large enough to wipe 
out any interaction effect: the average activity ( 07 ) of 
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FIG. 2: (Color online) Activity profiles p A (x) (red, left pan¬ 
els) and p B (y) (blue, right panels) computed from replica the¬ 
ory for (a) the phase CL A (T = 0.006, (b) the transition state 
TS 2 (T = 0.006), (c) the transition state TS A (T = 0.007). 
Profiles attached to Ch B and TSf are obtained from CL A 
and TS a by swapping p A and p B . Densities were discretized 
over 201 bins. Parameter values: / = 0.1, w = 0.05, L = 2 
one-dimensional maps. 
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FIG. 3: (a) Region of stability of the CL phase and PM-SG 
boundary in the (a,T) plane (thick lines); the PM and SG 
phases coexist with the CL phase, respectively, above and 
below the dotted line. Dashed line: boundary between 1- 
and 2-bump transition state (TS) scenarios, (b) Theoretical 
barriers A T/T vs. temperature T for L = 2 environments. 
Same parameter values as in Fig. [2] 

each neuron coincides with the global average activity, 
/. In the SG phase, activities are non uniform ((cq) /) 

for a given realization of the maps, but reflect the ran¬ 
dom crosstalk between the maps: they do not code for a 
well-defined position in any environment. 

To understand the transition mechanisms we look for 
saddle-points of J 7 , through which the transition path¬ 
way connecting Ch A to CL B will pass with minimal 
free-energy cost N A T. According to nucleation theory 
[T6] we expect those transition states (TS) to be unsta¬ 
ble along the transition pathway, and stable along the 
other directions. We identify two types of TS, referred 
to as 1 and 2 respectively, depending on the number of 
maps in which the activity is localized at the saddle-point 
(Fig. [2jb)&(c)). The corresponding transition pathways 
are schematized in Fig. [4j Which type of TS is chosen 
by the system depends on the values of a and T, see 

Fig- Ha). 

At low enough temperature the transition pathway 
passes through a transition state, TS 2 , where the activ¬ 
ity is equally localized in both maps (Fig. [2jb)). TS 2 is 
a minimum of the free-energy T in the symmetric sub¬ 
space p A = p B , and is unstable against one transverse 
fluctuation mode (Fig. J^a)). The barrier A T is the dif¬ 
ference between the free-energies of TS 2 and CL [16 , and 
is shown as a function of temperature in the case L = 2 
in Fig. §b). For a given realization of the maps, the 
lowest free-energy barrier will be achieved by centering 
the bumps around positions fin A and y in B, such that 
the maps are locally similar, i.e. such that the adjacency 
matrices of the maps locally coincide. We define the local 
resemblance between maps A and B at respective posi¬ 
tions x and y through 

1 N 

Res AB {x,y) = —'Y^p{x-x v A {i) )p{y-x^B( i) ) , (5) 

V 2=1 



FIG. 4: (Color online) Top: representative points of the CL A , 
CL S , PM or SG phases, and of the saddle-points TS 2 (left), 
TSf and TSf (right). Coordinates correspond to the aver¬ 
aged squared densities in maps A (x-axis) and B (y- axis), and 
arrows represent the stability of the phases and saddle-points. 
The transition pathways are sketched by the green straight 
lines. Bottom: Monte Carlo simulations illustrating the tran¬ 
sition scenarios, and energy contributions due to each map in 
units of f 2 w /2 (x-axis as in Fig. [l]); Dotted lines, from left 
to right: theoretical values of the energies in the CL, TS, PM 
phases. Parameter values: N — 1000,/ — 0.1 ,w — 0.05, L — 
2, T = 0.006 (left) and T = 0.007 (right). 

where p denotes the bump profile of TS 2 in Fig. [2j com¬ 
mon to the two maps. Res ab{x^p) is shown in Fig. HD 
for two randomly drawn one-dimensional maps, and com¬ 
pared in Fig. [5j[b) to the number of transitions, starting 
at position x in A and ending at position y in B (or 
vice-versa), observed in Monte Carlo simulations. Both 
quantities are strongly correlated, showing that transi¬ 
tions take place at positions where maps are most similar, 
as intuited in m • In addition, those ‘gateway’ positions 
are energetically favorable, and kinetically trap the activ¬ 
ity bump (Fig. [l]), hence making transitions more likely 
to happen. 

At high temperatures or loads no saddle-point of T 
localized in two maps can be found. At such tempera¬ 
tures or loads the PM or the SG phase coexists with CL 
(Fig. [3][a)). The PM/SG phase is separated from CL A 
by a transition state TSf (Figs. He) & [ijb)), and from 
CL B by a transition state TSf. The transition pathway 
goes from Ch A to TSf, then to TSf at constant T level, 
before reaching CL B (Fig.^b)). The barrier A T is given 
by the difference between the free energies of CL and TSi, 
and is shown in Fig. ^b). Note that at intermediate T 
or a values PM or SG are very shallow local minima of 
-F(Fig.Hb), dotted line). The system is likely to tran¬ 
siently visit PM or SG from TSf or TSf. The activity 
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(a) Resemblance (b) Nb. of transitions 
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FIG. 5: (a) Local resemblance of maps (contour lines of 

Res AB(x,y)), and (b) number of transitions between posi¬ 
tions a; in A and y in B observed in Monte Carlo simulation, 
for two randomly drawn one-dimensional maps A and B. Pa¬ 
rameters: T — 0.006,/ — 0.1, ic — 0.05, L = 2,N = 333. 
Transitions were counted over 10 6 rounds of lOiV MC steps, 
with starting/ending positions binned in 25 cells in each map. 


configurations are then delocalized in both maps, before 
eventually condensating into the CL phase. Model © 
defines a dilute ferromagnet with inhomogeneities in the 
interaction network, see ©• Bumps of neural activity are 
likely to melt, and TSi-based transitions to take place, 
where the network is less dense [15] . 

Two-clump (TS 2 ) and one-clump/delocalized (TSi) 
transition scenarios are observed in simulations as re¬ 
ported in Fig.[4]and Supplemental Material, Figs. 4, 5&6, 
whether the CL phase coexist with the PM (small loads 
a) or the SG (moderate loads) phases, see Fig.[3ja). The 
two scenarios also coexist over a range of temperatures 
(Fig. |3jb)), and may be alternatively observed in finite- 
size simulations. As an illustration the second transition 
in Fig. |T] is of type 1 (at ~ 1.05 10 6 MC steps), while all 
three other transitions are of type 2. The boundary line 
along which both scenarios have equal free-energy barri¬ 
ers is shown in Fig. |3ja). Simulations confirm that the 
transition rate increases with a and T, and decreases ex¬ 
ponentially with N (Supplemental Material, Figs. 1&2). 

It is interesting to compare the scenarios above to the 
experiment by K. Jezek et al. [4|, in which a rat was 
trained to learn two environments, A and B, differing 
by their light conditions. The activity of ~ 30 recorded 
place cells was observed to rapidly change from being 
typical of environment A to being typical of environment 
B, or vice-versa, either spontaneously, or as a result of a 
light switch. During light cue-induced transitions mixed 
states, correlated with the representative activities of 
both maps were observed for a few seconds (Figs. 3a&b, 
and Supplementary Figs. 6&7b in [4]). Spontaneous tran¬ 
sitions were also found to take place, in correspondence 
to mixed states, or to neural configurations seemingly un¬ 
correlated with A and B, see Fig. 3c in [4]. Those findings 
are qualitatively compatible with our two transition sce¬ 
narios. A quantitative comparison of our model with the 
neural activity in the CA3 and CA1 areas recorded in [4] 
will be reported in a forthcoming publication. 


Our work could be extended along several lines, e.g. to 
study the consequences of rhythms, such as the ^ 8 Hz 
Theta oscillations, believed to be very important for the 
exploration of the space of neural configurations [20] . 
and, hence, for transitions mm- In addition, we have 
assumed here, for the sake of mathematical tractability, 
that the coupling matrix in each map was homogeneous 
(the number of neighbors of each neuron is uniform across 
the population), a result of perfect exploration and learn¬ 
ing of the environment. In reality, imperfect learning, ir¬ 
regularities in the positions and shapes of place fields, and 
the sparse activity of place cells in CA1 [22], and even 
more so in CA3 will concur to produce heterogeneities 
in the coupling matrix. Numerical simulations suggest, 
however, that the mechanisms of transitions we have ana¬ 
lytically unveiled in the homogeneous case are unaltered 
in the presence of heterogeneities (Supplemental Mate¬ 
rial). Last of all, the notion of space itself could be re¬ 
visited. The ‘overdispersion’ of the activity of place cells 
[23] . its dependence on task and context [24], ... sug¬ 
gest that place cells code for ‘positions’ in a very high¬ 
dimensional space, whose projections onto the physical 
space are the commonly defined place fields. Extend¬ 
ing our study to the case of generic metric spaces could 
be very interesting, and shed light on the existence of 
fast transitions between task-related maps [25] and, more 
generally, on the attractor hypothesis as a principle gov¬ 
erning the activity of the brain. 
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